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APPARATUS AND METHOD FOR EMBEDDING AND 
EXTRACTING INFORMATION IN ANALOG SIGNALS 
USING REPLICA MODULATION 



5 Field Of the Invent- i or, 

This invention relates to apparatus and methods for 
encoding or embedding and decoding or extracting 
information in analog signals, such as audio, video and 
data signals, either transmitted by radio wave 
10 transmission or wired transmission, or stored in a 
recording medium such as optical or magnetic disks, 
magnetic tape, or solid state memory. 
Background and DescripUnn o f r^i^ ,^ Rrr 

The present invention is concerned with techniques 
for embedding and extracting auxiliary information within 
an existing signal, such as an audio or video signal. 

An area of particular interest to certain embodiments 
of the present invention relates to the market for musical 
recordings. Currently, a large number of people listen to 
20 musical recordings on radio or television. They often 

hear a recording which they like enough to purchase, but 
don't know the name of the song, the artist performing it, 
or the record, tape, or CD album of which it is part. As 
a result, the number of recordings which people purchase 
25 is less than it otherwise would be if there was a simple 
way for people to identify which of the recordings that 
they hear on the radio or TV they wish to purchase. 
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Another area of interest to certain embodiments of 
the invention is copy control (also referred to as digital 
watermark) . Ther e is currently a large market for 
audxo software products, such as musical recordings. One 
5 of the problems in this market is the ease of copying such 
products without paying those who produce them. This 
problem is becoming particularly troublesome with the 
Tit? °l re u C ° rd± ^ ^chniques, such as digital audio tape 
(DAT) , whxch make it possible for copies to be of very 
10 high quality. Thus it would be desirable to develop a 
scheme which would prevent the unauthorized copying of 
audxo recordings, including the unauthorized copying of 
audio works broadcast over the airwaves. it is also 
desirable for copyright enforcement to be able to insert 
xnto program material such as audio or video signals 
dxgxtal copyright information identifying the copyright 
holder, which information may be detected by appropriate 
apparatus to identify the copyright owner of the program, 
whxle remaining imperceptible to the listener or viewer 

Yet another field of interest relating to the present 
xnvention pertains to automatic royalty tracking and proof 
of performance of copyrighted material or commercial 
advertisements, by which copyright owners are able to 
track public performances or broadcasts of their material 
for royalty payment purposes, and advertisers are able to 
confxrm that commercials which they have paid for were 
actually broadcast at the proper time and date. 

Still another area of interest to the present 
xnvention relates to integrity verification or tampering 
detectxon, wherein the creator of an audio or audiovisual 
work can determine whether it has been altered, modified 
or xncorporated into another work. 
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Various prior art methods of encoding additional 
information onto a source signal. are known. For example, 
it is known to pulse-width modulate a signal to provide a 
common or encoded signal carrying at least two information 
portions or other useful portions. In U.S. Patent No 
4,497,060 to Yang (1985) binary data is transmitted as a .. 
sagnal having two differing pulse-widths to represent 
logical -o- and -i- (e.g., the pulse-width durations for a 
"1" are twice the duration for a "0") . This 
correspondence also enables the determination of a 
clocking signal. 

With respect to systems in which audio signals 
produce audio transmissions, U.S. Patent Nos . 4,876,617 to 
Best et al. (1989) and 5,113,437 to Best et al . (1992) 
disclose encoders for forming relatively thin and shallow 
(e.g., 150 Hz wide and 50 dB deep) notches in mid-range 
frequencies of an audio signal. The earlier of these 
patents discloses paired notch filters centered about the 
2883 Hz and 3417 Hz frequencies,- the later patent 
discloses notch filters but with randomly varying 
frequency pairs to discourage erasure or inhibit filtering 
of the information added to the notches. The encoders 
then add digital information in the form of signals in the 
lower frequency indicating a "0" and in the higher 
frequency a "1". m the later Best et al . patent an 
encoder samples the audio signal, delays the signal while 
calculating the signal level, and determines during the 
delay whether or not to add the data signal and, if so, at 
what signal level. The later Best et al . patent also 
notes that the '-pseudo- random manner- in moving the 
notches makes the data signals more difficult to detect 
audibly . 
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Other prior art techniques employ the psychoacoustic 
model of the human perception characteristic to insert 
modulated or unmodulated tones into a host signal such 
that they will be masked by existing signal components and 
thus not perceived. ^ ^ Preuss et al . , U.S. Patent 
No. 5,319,735, and Jensen et al . , U.S. Patent No. 
5,450,490. such techniques are very expensive and 
complicated to implement, while suffering from a lack of 
robustness in the face of signal distortions imposed by 
perception-based compression schemes designed to eliminate 
masked signal components. 

The prior art fails to provide a method and an 
apparatus for embedding and extracting auxiliary analog or 
digital information signals onto analog audio or video 
frequency signals for producing humanly perceived 
transmissions (i^, sounds or images) such ^ ^ 

or video frequency signals produce substantially identical 
humanly perceived transmission prior to as well as after 
encoding with the auxiliary signals (in other words, the 
embedded information is transparent to the listener or 
viewer) , which is also robust to a high degree of signal 
distortions caused by noisy transmission mediums, etc 
The prior art also fails to provide relatively simple and 
inexpensive apparatus and methods for embedding and 
extracting signals defining auxiliary information into 
audio or video frequency signa i s for producing humanly 
perceived audio transmissions. 

SUMMARY OF thp TKfYFINTT"^ 
The present invention provides apparatus and methods 
for embedding or encoding, and extracting or decoding 
auxiliary (analog or digital) information in an analog 
host or cover signal in a way which has minimal impact on 
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the perception of the source information when the analog 
signal is applied to an appropriate output device, such as 
a speaker, a display monitor, or other 
electrical/electronic device. 
5 The present invention further provides apparatus and 

methods for embedding and extracting machine readable 
signals in an analog cover signal which control the 
ability of a device to copy the cover signal. 

In summary, the present invention provides for the 
10 encoding or embedding of an auxiliary signal in an analog 
host or cover signal, by generating a replica signal from 
the cover signal, modifying the replica signal as a 
function of the auxiliary signal, and inserting the 
modified replica signal back into the analog cover signal 
15 to provide a stego signal. The invention further provides 
for the extraction of embedded auxiliary signals from 
stego signals by generating a replica of the stego signal, 
and correlating the replica with the stego signal. 
According to another aspect of the invention, 
20 apparatus for embedding and extracting auxiliary signals 
in an analog cover signal, is provided, comprising a 
replica generator for generating a replica signal from the 
cover signal, a modulator for modifying the replica signal 
as a function of the auxiliary signal, an adder for 
inserting the modified replica signal back into the analog 
cover signal to produce a stego signal, a receiver for 
receiving the stego signal, a generator for generating a 
replica signal from the stego signal, a modulator for 
modifying the received stego signal as a function of the 
replica signal of the received stego signal, and an 
extractor for extracting the auxiliary signal by filtering 
the modified received stego signal . 
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hog , m C ° Ver Signal as used hereinafter refers to a 

info rlir rCe Signa1 ' SUCh ^ 3n aUdi °' Video ^ other 

TZ l S19na1 ' WhiCh Carr±eS ° r is inte ^d to carry 
embedded or hidden auxiliary data. 

5 brief pespftpttom op TH F ogams ' 

These and other aspects of the present invention will" 
become more fully understood from the following detailed 

wIt S hT 10n ° f PrSferred e ^° di — i» conjunction 

with the accompanying drawings, in which- 

10 „ FIG - 1 ±S 3 bl ° Ck dia 9" m of a data signal embedding 

and extracts process utilized by the present invention; 

FIG. 2 is a block diagram of one embodiment of the 
emoeddor 10 of Fig. i ; 
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k .I'!' 3 ^ 3 bl ° Ck dia 9 ram of one embodiment of the 
embedded signal generator 11 of Fig. 2; 

FIG. 4 is a block diagram of one embodiment of the 
data signal extractor 2 0 according to the present 
invention; 

FIG. 5 is a block diagram of one embodiment of a 
replica generator which produces a cover signal replica 



shifted in frequency from the original; and" 

FIGs. 6 (a) -6(c) are graphs showing a set of 

orthogonal functions used in the creation of an amplitude- 

25 Mention '° ~ ^ ^ ~ 
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DETAITiKP DESSBienaa np thr ESEEESBED ElffiQBIM EEIS 
The present invention is directed to a method and 
apparatus for embedding information or data onto a cover 
signal, such as an audio signal, video signal, or other 
analog signal (hereinafter called a "cover signal"), by 
generating a replica of the cover signal within a 
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predefined frequency, time and/or space domain, modulating 
the replica with an auxiliary signal representing the 
information to be added to the cover signal, and then 
inserting the modulated replica back into the cover 
5 signal. The invention can implemented in a number of 
different ways, either by software programming of a 
digital processor, in the form of analog, digital, or 
mixed- signal integrated circuits, as a discrete component 
electronic device, or a combination of such 

10 implementations. The replica is similar to the cover 

signal in time and frequency domain content, but different 
in certain parameters as specified by a stego key, which 
is not generally known, but which is known at authorized 
receiving apparatus . 

15 Referring to Fig. 1, the invention employs an 

embeddor 10 to generate a stego signal 4, which is 
substantially the same in terms of the content and quality 
of information carried by a cover signal 2. For instance, 
where cover signal 2 is a video or audio signal, the stego 

20 signal 4 will produce essentially the same video or audio 
program or information when applied to an output device 
such as a video display or loudspeaker. 

A stego key 9 is used to determine and specify the 
particular region of the time, frequency and/or space 

25 domain of the replica where the auxiliary signal 6 is to 
be embedded, as well as the parameters of the embedding 
process . 

The embeddor then appropriately modulates or modifies 
the replica and adds the replica back into the cover 
signal to obtain a stego signal 4. Stego signal 4 can be 
transmitted, or stored in a storage medium such as 
magnetic tape, CD-ROM, solid state memory, and the like 
for later recall and/or transmission. The embedded 
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auxiliary signal is recovered by an extractor 20, having 
knowledge of or access to the stego Key 9 , which opera ^ s 

The el S d r Slgnal 4 t0 SXtraCt thS «*«i«Y signal S. 
The embedding process can be expressed by the formula: 

s(t)= s(t)+y Wi ( t ) 

i ( 1 )" 

where s(t) represents the stego signal 4, s (t) represents 
the cover signal 2, and Wl (t) is the i-th hi**- 7 
(see Fir, o \ n hidden signal 8 

tnf K J ' " " 3 Wafcerma ^. m this regard, 

the embeddor can be used to insert multiple auxiliary^ 
signals 6 simultaneously, using a different stego key 9 
for each signal. m the case where only a single 

T'T°?T< . ±S - — ' * — -ego Key S 



' — "*"a-i.c £>L.e 

s used, and there would be only one hidden signal w(t, 
15 In equation (l) and hereinafter, a one- dimensional signal 

su^T 9 " ignal Varyin9 aCCOrdin 9 to * single dimension, 
such as time) is considered for purposes of simplicity in 
explanation; however, the present invention is not limited 
to one-dimensional signals but can be readily extended to 

v^eo dl ( ~: al Si9nalS SUCh - - 9 es (two dimensions) , 
video (three dimensions), etc., by defining t as a vector 
According to the present invention, a replica of the" 
cover signal 2 itself is used as a carrier for the 
auxiliary signal 6 . Because the replica is inherently 
similar to the cover signal in terms of frequency content 
no analysis of the cover signal is necessary in order to 
hide an auxiliary signal, such as a digital watermark 

in contrast, according to the prior art techniques 
discussed above, auxiliary signals are embedded in the 
form of a pseudorandom sequence (Preuss et al . ) or in the 
form of mul tiple tones distributed over the frequency band 
of the cover signal (Jensen et al.). In order to „J de „ 
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such signals so that they are perceptively transparent, it 
was necessary to perform an analysis of the cover signal 
in the frequency domain to make the watermark signal 
imperceptible to the observer. Such analysis is based on 
5 the phenomenon that human perception will not detect a 

smaller signal in the presence of a larger signal if the 
two signals are sufficiently similar. This phenomenon is " 
usually known as the masking effect. 

The embedded signal 8 according to the present 
10 invention can be expressed by the formula: 
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Wi (t) =gimi (t) r 4 (t) 



(2) 



where gi ( 1 is a gain (scaling factor) parameter 
determined by tradeoff considerations of robustness versus 
transparency, m^t) is the auxiliary signal 6, wherein 
|mi(t)|s;l, and r 4 (t) is a replica of the cover signal 2. 
The gain factor gi can be a predetermined constant for a 
given application, or it can be adaptable, such that 
dynamic changes in transparency and robustness conditions 
can be taken into account. For example, in highly tonal 
musical passages the gains can be lower, while for 
spectrally rich or noisy audio signals the gains can be 
higher, with equivalent levels of transparency. In an 
alternate embodiment, the embeddor can perform an 
extractor process simulation to identify signals having 
less than desirable detectability , and increase the gain 
accordingly. 

Fig. 2 shows a block diagram of one preferred 
embodiment of the embeddor 10. As shown, the cover signal 
2, stego key 9, and auxiliary signal 6 are inputted to an 
30 embedded signal generator 11. The embedded signal 

generator generates replica r,(t) from cover signal 2 
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according to the stego key 9, modulates or modifies the 
replica r l( t) with auxiliary signal 6 (m, (t) ) , scales the 
result using gain parameter 9l , and generates an embedded 
sxgnal 8 (w i(t )). The embedded signal 8 is then added to 
the cover signal 2 ( s (t)) in an adder 12, to produce the 
stego signal 4 (s(t)). 

The replica r i( t) is obtained by taking a portion of " 
the cover signal 2 within a specified time, frequency 
and/or spatial domain as specified by the stego key 9, and 
then making slight modifications to the signal portion 
also as specified by the stego key 9. The modifications 
to the signal portion need to be small to ensure that the 
replxca remains similar to the cover signal as judged by 
the human psychoacoustic-psychovisual systems, but such 
modifications must be large enough to be detectable by an 
appropriately designed extractor having knowledge of or 
access to the stego key 9. As will be discussed below, a 
number of different types of modifications have been found 
to satisfy these requirements. 

Equation (2) reveals that the replica ri (t) is 
modulated by the auxiliary signal m i( t) according to a 
process known as product modulation. Product modulation 
results in a broadening of the spectrum of the embedded 
signal proportionally to the spectral width of the 
25 auxiliary signal. m order to make the spectrum of the 
embedded signal similar to the spectrum of the cover 
signal (to preserve the transparency of the embedding 
process) the spectrum of the auxiliary signal must be 
narrow in comparison with the lowest frequency in the 
30 spectrum of the replica. This requirement imposes a limit 
on the capacity of the auxiliary channel, and dictates 
that low frequency components of the cover signal are 
unsuitable for inclusion in the creation of the replica 
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in a preferred embodiment of the invention, the 
modulating signal (auxiliary signal) m(t) is a binary data 
signal defined by the formula: 

m(t)=£b n h(t-nT) 

n=l (3) 

where N is the number of binary digits or bits in the 
message, b n e(-i,i) is the n-th bit value, t is the bit 
interval, and h(t) represents the shape of the pulse 
representing the bit. Typically, h(t) is obtained by low- 
pass filtering a rectangular pulse so as to restrict the 
spectral width of the modulating (auxiliary) signal. 

Fig. 3 illustrates the details of an embedded signal 
generator 11 used to generate a single embedded data 
15 message. The cover signal 2 is filtered and/or masked in 
filtering/masking block 30 to produce a filtered/masked 
signal 31. The filter /mask block 30 separates regions of 
the cover signal used for different embedded messages. 
For example, the filter/mask block may separate the 
20 frequency band region 1000-3000 Hz from the cover signal 
in the frequency domain, may separate the time interval 
region t=10 seconds to t=3 0 seconds from the cover signal 
in the time domain, or may separate the upper right 
spatial quadrant region of the cover signal in the spatial 
25 domain (such as where the cover signal is an MPEG, JPEG or 
equivalent signal) which separated region would then be 
used for auxiliary signal embedding. 

The filtered/masked signal 31 is comprised of the 
selected regions of the cover signal, as specified by 
stego key 9, which are then used for creation of the 
replica signal 41. The signal 31 is then inputted to a 
replica creator 40, where predetermined parameters of the 
signal are modified, as specified by stego key 9, to 

11 
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create the replica r l(t ) 41. The replica 41 is then " 
modulated by the auxiliary signal m l( t) in multiplier 42a 
and the resultant signal is then scaled in multiplier 42b 
according to the selected gain factor 9l to produce 
embedded signal component 8 (j^, Wl(t ) in equation (2)) 
The embedded signal component 8 is then added back to the 
cover signal 2 in adder 12 (Fig. 2) to obtain the stego 
signal 4. In order to maintain synchronization between 
the cover signal 2 and the embedded signal component 8, 
inherent processing delays present in the filter/mask 
block 30 and replica creator block 40 are compensated for 
by adding equivalent an delay ± n the cover signal circuit 
path (between the cover signal input and the adder 12) 
shown in Fig. 2. 

It is further possible to embed multiple auxiliary 
data signals in the cover signal 2, by using multiple 
embedded signal generators, each using a different stego 
key to modify a different feature of the cover signal 
and/or to use different regions of the cover signal, so as 
to produce multiple embedded signal components each of 
which are added to the cover signal 2. Alternatively, the 
different data signals may be embedded in a cascade 
fashion, with the output of one embeddor becoming the 
input of another embeddor using a different stego key m 
25 either alternative interference between embedded signal 

components must be minimized. This can be accomplished by 
using non-overlapping frequency, time or space regions of 
the signal, or by selecting appropriate replica creation 
parameters, as disclosed below. 

A block diagram of an extractor used to recover the 
auxiliary data embedded in the stego signal is shown in 
Pig. 4. The stego signal 4 is filtered/masked in 
filter/mask module 30a to isolate the regions where the 
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auxiliary data is embedded. The filtered signal 3ia is 
inputted to replica creator 40a where a replica r t (t) 4la 
of the stego signal is generated in the same manner as the 
replica r^t) of the cover signal in the replica creator 
block 40 in the embeddor, using the same stego key 9. The 
replica rj(t) of the stego signal 4 can be expressed by 
the formula : 



r ± (t)= r i (t)+Jg i R(m i (t)r i (t) )= ri (t) 



(4) 



where R (m t (t) r £ (t) ) represents the replica of the 
modulated cover signal replica. For sufficiently small 
gain factors g, the replica of the stego signal is 
substantially the same as the replica of the cover signal. 

In the extractor 20, the replica ri (t) 41a is 
multiplied by the stego signal 31a in multiplier 42c to 
obtain the correlation product: 

c(t)=r i (t)s(t)=r j (t)s(t) + £g i m i (t)r i (t)r j (t) (5) 

In designing the replica signal, one objective is to 
obtain spectra of the products r,(t)s(t) and r 1 (t)r J (t), 
i*j, with little low frequency content. On the other 
hand, the spectra of the product r 3 (t) r, (t) = rj 2 (t) contains 
a strong DC component, and thus the correlation product 
c(t) contains a term of the form (tjmeantrj 2 ) , i.e. . 
c(t) contains the scaled auxiliary signal TOl (t) as a 
summation term. 

in order to extract the auxiliary signal m 4 (t) from 
the correlation product c(t), filtering is performed on 



13 



WO 00/00969 



PCT/US99/13482 



e(t) by filter 44, which has a filter characteristic 
matching the spectrum of the auxiliary signal . For 
example, in the case of a binary data signal with a 
rectangular p U l se shape , the matched fllt corresponds 
to integration over the bit interval. m the case of 
3 Z,T Signalin9 ' thS fil ^ring operation is followed by 
symbol regeneration in a regenerator 46. A multiplicity 
of the extracted data symbols is then subjected to well- 
known error detection, error correction, and 
synchronization techniques to verify the existence of an 
actual message and proper interpretation of the content of 
the message. 

One preferred embodiment of a replica creator 40 is 

T2r Xn F t 9 : 5 ' ^ emb ° diment < * -P^ca signal 41 

is obtained by shifting the frequency of the filtered 
cover signal 31 by a predetermined offset frequency f t as 
specified by the stego key 9. This shifting process is 
also known as single sideband amplitude modulation, or 
frequency translation. m addition to the processing 
shown in Fig. 5, a number of different techniques known in 
the art are available to perform this process 

Blocks 52 and 54 represent respective phase shifts of 

T iC l nP "l S(t> ' T ° aChiSVe thS dSSired f-quency 

shift, the relationship between the phase shifts must be 
defined as : 



<Pi(f ) -cp 2 (f )=90° 

(6) 

The respective phase-shifted signals are multiplied by 
sinusoidal signals with frequency f, in respective 
multipliers 56a and 56b. Block 58 denotes a 90° phase 
shift of the sinusoidal signal applied to multiplier 56b 
The resulting signals are then combined in summer 59 



14 



WO 00/00969 

PCT/US99/13482 

Thus, the replica signal 41 can be expressed as: 

r, (t) = s ( t/<Pl ) sin Un^t) ±s (t , <p 3 ) cos (2nf it ) (7) 
where s(t,( Pi ) denotes signal s(t) phase-shifted by <p t . 
The sign - or + in the summation process represents a 
respective shift up or down by f l . According to 
psychoacoustic models published in the literature better " 
masking may be achieved when the shift is upward 
Accordingly, in the preferred embodiment subtraction is 
used in equation (7) . Jn a special case <p 1= 90° and <p 2 =o°, 
such that equation (7) becomes: 

r± (t) -s h (t) sin(2nf 1 t) ±s (t) cos (2nf ± t) (8) 

where s h (t) is a Hilbert transform of the input signal 
defined by; ' 

oo 

s h (t)=i/n / sjxldx 

-» W (9) 

The Hilbert transform may be performed in software by 
various known algorithms, with equation (8) being suitable 
for digital signal processing. For analog signal 
processing, it is easier to design a circuit pair that 
maintains the 90" relative phase shifts throughout the 
signal spectrum, than to perform a Hilbert transform. 

The particular frequency offset f 4 can be chosen from 
a wide range of frequencies, and specified by the stego 
key. Multiple auxiliary signals can be inserted into the 
same time, frequency and/or space domain of the same cover 
signal, by having a different frequency offset value to 
thus achieve a "layering" of auxiliary signals and 
increase auxiliary channel throughput. 

The frequency offset also may be varied in time 
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according to a predefined secret pattern (known as 

frequency hopping"), to improve the security of a digital 
watermark represented hy the auxiliary information 

The particular choice of frequency offset values is 
dependent upon the conditions and parameters of the 

TrlTllT aPPliCati ° n ' - d «" b * ^ther fine tuned hy 
trial and error. According to experimental results, 
optimal sxgnal robustness in the presence of channel 
distortion was achieved where the frequency offset value 
was larger than the majority of spectrum frequencies of 

TtZT: 9 aUX±liary Signal • On the other hand. 

Optimal transparency was achieved where the frequency 
offset value was substantially smaller than the lowest 
frequency of the cover signal As an 

i w aJ . example, for audio 

signal embedding a cover signal above 500 Hz was used with 
a frequency offset of 50 Hz, while the modulating signal 
was a binary data signal with a bit rate of 25 bps 

In an alternative embodiment of a replica creator, 
the replica is generated by shifting the phase of the 
filtered/masked portion 31 of the cover signal by a 
predetermined amount defined by a function Vl (f ) for an ± . 

40 Si9 ? al - In th±S ° aSe ' rSplica ^nerators 

40 and 40a are Ixnear systems having a transfer function 
defined as: 

H i (f)=A i e^ i <f) 

(10) 

Where A, is a constant with respect to frequency, j is the 
imaginary number v^T, and Vi (f ) is the pha3e 

characteristic of the system. Circuits described by 
equation (10) are known in the art as all-pass filters or 
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phase correctors, and their design is well-known to those 
skilled in the art. 

This embodiment is particularly suitable for 
auxiliary signal embedding in audio signals, since the 
human audio sensory system is substantially insensitive to 
phase shifts. The functions <p A (f) are defined to meet 
the objective that the product of the replica and the 
cover signal contain minimal low frequency content. This 
can be achieved by maintaining at least a 90° shift for 
all frequency components in the filtered/masked signal 31 
Multiple embedded messages have been implemented with 
little interference where the phase shift between 
frequency components of different messages is larger than 
90° for the majority of the spectral components. The 
exact choice of the function cp^f) is otherwise governed 
by considerations of tradeoff between cost and security 
In other words, the function should be complex enough so 
that it is difficult for unauthorized persons to determine 
the signal structure by analyzing the stego signal, even 
with the known cover signal, yet it should be 
computationally inexpensive to implement. A function 
hopping pattern which switches between different functions 
at predetermined intervals as part of the stego key can be 
used to further enhance security. 

A special class of phase shift functions, defined by 

(Mf)= X if 

where T t is a constant, results in time shift replicas of 
the cover signal . This class of functions has special 
properties in terms of cost/security tradeoff, which are 
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beyond the scope of the present rH 

further treated here. ^closure and will not be 

inven™th! " l*""™ «*«»«-* of the 

mventxon, the replxca generator obtains the replica 
sxgnal by amplitude modulatiQn Qf 

ampl.tude Adulation can he expressed hy the elation 

r i (t)=a l (t)s(t) 

"here a, (t) is a class of orthogonal functions. Pi g s ' 12 ' 
«(.)-«(o) illustrate a set o£ three elemene „ y l<m 
a,(t), a,(t,, and a, (t, used to generate a mp l ltude 
shifted replica signals, „ ith each tlmction 
over the interval ,o.T, „here X eguals the bit interval" of 
usingT \ iarV Bi9Ml - ^ - aerated ^ 

filterLo el6mentary fUnCti ° nB - ^"-rrelatL 

filtering in the extractor is performed by integration 

over the interval T. and the auxiliary obTnnel Mt b is 
extracted according to the formula Ensign ,*,.„, 

^="^'^i: f .M"t> a '(t,a t ,t,a )( t, d t 
s 9i fm, (t)s 2 (t)dt 

(n-l)T (13) 

The above approximations hold, since 

[a j (t)dt=0, /I 1 (t)a j (t)dt=0 f for anda^t)-! 

As is apparent from equation (13), the sign of A (and 

the received bit value) depends on the sign of m '("t, 

durxng the n-th bit interval, or in other words he 

! a r tted ValUS - ThS fUnCtio - — for amplitude 

shxftxng generally should have a small low frequency 
content, a spectrum below the lowest frequency^ the 
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filtered/masked signal, and should be mutually orthogonal 
The particular choice of functions depends upon the 
specific application, and is specified in the stego key 
According to yet another alternative embodiment, a' 
combination of different shifts in different domains can 
be executed simultaneously to generate a replica signal 
For example, a time shift can be combined with a frequency 
shift, or an amplitude shift can be combined with a phase ' 
shaft. Such a combination shift can further improve the 
hiding (security) property of the embedding system, and 
also improve detectability of the embedded signal by 
increasing the difference from the cover signal. 

With respect to security, attacks would be expected 
that incorporate analysis designed to reveal the 
parameters of the stego key. if such parameters become 
known, then the embedded signal can be overwritten or 
obliterated by use of the same stego key. Use of a 
combination of shifts makes such analysis more difficult 
by enlarging the parameter space. 

With respect to detectability, certain naturally 
occurring signals may have a content similar to a replica 
signal; for example, echo in an audio signal may produce a 
Phase shifted signal, choral passages in a musical program 
may produce a frequency shifted signal, and tremolo may 
produce amplitude shifts, which may interfere with 
embedded signal detection. Use of a combination of shifts 
reduces the likelihood that a natural phenomenon will 
exactly match the parameters of the stego key, and 
interfere with signal detection. 

The invention having been thus described, it will be 
apparent to those skilled in the art that the same may be 
varied in many ways without departing from the spirit and 
scope of the invention. Any and all such modifications as 
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What is ela-imcrj i a . 

1. A method for embedding an auxiliary signal in an 
analog cover signal, comprising the steps of: 

generating a replica signal from said cover signal; 
modifying said replica signal as a function of said 
auxiliary signal; and 

inserting the modified replica signal back into said 
analog cover signal. 

2. A method according to claim 1, wherein the step of 
generating comprises the step of modifying at least a 
portion of said cover signal in a predetermined domain 
according to a stego key. 

3. A method according to claim 2, wherein said 
predetermined domain is the frequency domain. 

4. A method according to claim 2, wherein said 
predetermined domain is the time domain. 

5. A method according to claim 2, wherein said 
predetermined domain is the spatial domain. 

6. A method according to claim 2, wherein said replica 
signal is obtained by shifting the frequency of said at 
least one portion of said cover signal by a predefined 
amount specified by said stego key. 

7. A method according to claim 2, wherein said replica 
signal is obtained by shifting the phase of said at least 
one portion of said cover signal by a predefined amount 
specified by said stego key. 

8. A method according to claim 2, wherein said replica 
signal is obtained by shifting the amplitude of said at 
least one portion of said cover signal by a predefined 
amount specified by said stego key. 

9. A method according to claim 2, wherein said replica 
signal is obtaining by shifting a predetermined 
combination of the frequency, phase, and/or amplitude of 
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said at least one portion of said cover signal by 
predefined amounts specified by said stego key 

10. A method according to claim 1, wher ein the step of 
-difyxng comprises the step of multipl ying said replica 
signal with said auxiliary signal. replica 

11. A method for extracting an embedded auxiliary signal 
from an analog stego signal, comprising the steps of 

generating a replica signal from said stego signal; 
modifying said stego signal as a function of said 
replica signal; and 

extracting said information symbol by filtering said 
modified stego signal. 

12. A method according to claim 11, where in the step of 
generating comprises the step of modifying at least a 

accordi ° f / aid Ste9 ° Si9nal in 3 P- d ^ermined domain 
according to a stego key. 

13. A method according to claim 12, wherein said 
predetermined domain is the frequency domain 

14. A method according to claim 12, wherein said 
predetermined domain is the time domain. 

15. A method according to claim 12, wherein said 
predetermined domain is the spatial domain 

sLal aCC ° rding t0 Claim 12 < therein said replica 

signal is obtained by shifting the frequency of said at 
least one portion of said stego signal by a predefined 
amount specified by said stego key. 

17. A method according to claim 12, wherein said replica 
signal is obtained by shifting the phase of sa id at least 

zizit: of s r ste9 ° si9nai ty a - edefi - ~ 

specified by said stego key. 
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18. A method according to claim 12, wherein said replica 
signal is obtained by shifting the amplitude of said at 
least one portion of said stego signal by a predefined 
amount specified by said stego key. 

19. A method according to claim 12, wherein said replica 
signal is obtained by shifting a predetermined combination 
of the frequency, phase and/or amplitude of said at least 
one portion of said stego signal by a predefined amount 
specified by said stego key. 

20. A method according to claim 11, wherein the step of 
modifying comprises the step of multiplying said replica 
signal with said stego signal . 

21. Apparatus for embedding and extracting auxiliary 
signals in an analog cover signal, comprising: 

means for generating a replica signal from said cover 
signal ; 

means for modifying said replica signal as a function 
of said auxiliary signal; 

means inserting the modified replica signal back into 
said analog cover signal to produce a stego signal; 

means for receiving said stego signal; 

means for generating a replica signal from said stego 
signal; 

means for modifying said received stego signal as a 
function of said replica signal of said received stego 
signal ; and 

means for extracting said auxiliary signal by 
filtering said modified received stego signal. 
22. Apparatus according to claim 21, wherein said means 
for generating a replica signal comprises means for 
modifying at least a portion of said cover signal in a 
predetermined domain according to a stego key. 
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23^ Apparatus according to claim 22, wherein said 

predetermined domain is the frequency domain. 

24. Apparatus according to claim 22, wherein said 

predetermined domain is the time domain 

25 Apparatus according to claim 22, wherein said 

predetermined domain is the spatial domain 

26. Apparatus according to claim 22, wherein said replica 
signal ls obtained by shifting fche said at 
least one portion of said cover signal by a predefined 
amount specified by said stego key. 

27. Apparatus according to claim 22, wherein said replica 
signal is obtained by shifting the phase of said at least 

:zr f ?: d °i of t cover si9nai hy * — 

specified by said stego key. 

28. Apparatus accordinq to claim or> „u 

, . y co CJ - aim 22, wherein said reolica 

signal is obtained by shifting the amplitude of said a 
least one portion of said cover signal by a predefined 
amount specified by said stego key. 

29- Apparatus according to claim 22, wherein said replica 
axgnal is obtaining by shifting a predetermined 

s^T^ast' freqUenCy ' and/ ° r * m * litUde ot 

said at least one portion of said cover signal by 

predefined amounts specified by said stego key 

30. Apparatus according to claim 21, wherein said means 

for modifying said replica signal comprises means foT 

"gnal 9 rSPliCa Sl9nal With Said auxi ^ary 
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